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DETAILED ACTION 
Information Disclosure Statement 

The references listed in the Information Disclosure Statement, filed on 13 May 
2005, have been considered by the examiner (see attached PTO-1449 form or 
PTO/SB/08A and 08B forms). 

Claim Objections 

1 . Claims 1, 5-9, 13-17, 20-22, 25-26 are objected to because of the following 
informalities: Applicant interchangeably uses the limitations "said plurality of media 
streams" and "said media streams" which are believed to mean the same limitation. If 
they are the same, it is suggested that Applicant stays consistent with the limitation 
terminology. Appropriate correction is required. 

Claim Rejections - 35 USC § 102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

3. Claims 1-5 and 17-19 are rejected under 35 U.S.C. 102(b) as being anticipated 
by White et al. (PG Pub US 2002/0049979 A1). 

Regarding Claim 1, White et al. discloses a method of streaming media 
("streaming and displaying video images", [0004] Lines 2-3 and Fig. 3), said 
method comprising: 
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receiving a plurality of media streams, said plurality of media streams having a 
mutual downstream destination ("camera system 300 (which includes camera 102A 
to 102B) provides images to unit 301", [0025], Lines 3-4 and Fig. 3) and a total 
bandwidth associated therewith (flowing table showing the bandwidth requirements 
of various configurations, [0054]); 

receiving information allowing identification of a selected media stream ("when 
the user "clicks on" anyone of the thumbnails, viewer software 303 sends a 
message to control system 302. Thereafter images from the camera associated 
with the thumbnail which was clicked are transmitted as the focus stream", [0025] 
Lines 13-17); 

performing a service on each of said media streams except for said selected 
media stream ("A major portion of the display is taken by the images from one 
particular camera. This is termed the focus stream. On the side of the display are 
four thumbnail images, one of which is associated with each of the camera 102A 
to 102D", [0024] Lines 3-7), said service reducing a respective initial bandwidth of 
each media stream other than said selected media stream so that said total bandwidth 
is reduced ("if desired the frame rate can be reduced by eliminating frames in 
order to further reduce the bandwidth required. The exact amount that the 
resolution is reduced depends on the particular application and on the amount of 
bandwidth available", [0026] Lines 7-1 1 ); and 

streaming said plurality of media streams, wherein said media streams other than 
said selected media stream are streamed at less than their respective initial bandwidths 
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("Stream T is a thumbnail stream, that is, a single stream of images wherein each 
image in the stream has a thumbnail image from each of the cameras. Stream F is 
the focus stream of images which transmits the high resolution images which 
appear on the user's display", [0027] Lines 6-11). 

Regarding Claim 2, White et al. discloses everything claimed as applied above 
(see Claim 1). In addition, White et al. discloses said service comprises a transcoding 
operation ("if desired the frame rate can be reduced by eliminating frames in order 
to further reduce the bandwidth required", [0026] Lines 7-9). 

Regarding Claim 3, White et al. discloses everything claimed as applied above 
(see Claim 2). In addition, said transcoding operation is selected from the group 
consisting of bitrate reduction, rate shaping, spatial downsampling, spatial resolution 
reduction, frame rate reduction, key frame selection, a change in compression format, 
data packet elimination, and data packet truncation ("if desired the frame rate can be 
reduced by eliminating frames in order to further reduce the bandwidth required", 
[0026] Lines 7-9). 

Regarding Claim 4, White et al. discloses everything claimed as applied above 
(see Claim 1). In addition, receiving information identifying a type of service to be 
performed ("The web client 402 includes a stream selection control 403. This may 
for example be a conventional mouse. When the user, clicks on one of the 

< 

thumbnails, a signal is sent to the server 401 and the focus stream F is changed 
to the stream of images that coincides with the thumbnail that was clicked", 
[0028] Lines 1-6). 
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Regarding Claim 5, White et al. discloses everything claimed as applied above 
(see Claim 1). In addition, a single device receives said media streams and performs 
said service ("Camera system 300 (which includes camera 102A to 102B) provides 
images to unit 301 which edits the image streams and which creates the 
thumbnail image stream", [0025] Lines 3-6). 

Regarding Claim 17, White et al. discloses a computer-usable medium having 
computer-readable program code embodied therein for causing a network mixing device 
to perform a method of streaming media ("streaming and displaying video images", 
[0004] Lines 2-3), said method comprising: 

receiving a plurality of media streams, said plurality of media streams having a 
mutual downstream destination ("camera system 300 (which includes camera 102A 
to 102B) provides images to unit 301", [0025], Lines 3-4 and Fig. 3) and a total 
bandwidth associated therewith (flowing table showing the bandwidth requirements 
of various configurations, [0054]); 

executing ah operation on each of said media streams except for at least one 
media stream ("A major portion of the display is taken by the images from one 
particular camera. This is termed the focus stream. On the side of the display are 
four thumbnail images, one of which is associated with each of the camera 102A 
to 102D", [0024] Lines 3-7), said operation reducing a respective initial bandwidth of 
each media stream other than said at least one media stream so that said total 
bandwidth is reduced ("if desired the frame rate can be reduced by eliminating 
frames in order to further reduce the bandwidth required. The exact amount that 
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the resolution is reduced depends on the particular application and on the 
amount of bandwidth available", [0026] Lines 7-11); and 

streaming said plurality of media streams, wherein said media streams other than 
said at least one media stream are streamed at less than their respective initial 
bandwidths ("Stream T is a thumbnail stream, that is, a single stream of images 
wherein each image in the stream has a thumbnail image from each of the 
cameras. Stream F is the focus stream of images which transmits the high 
resolution images which appear on the user's display", [0027] Lines 6-11). 

Regarding Claim 18, White et al. discloses everything claimed as applied above 
(see Claim 17). In addition, White et al. discloses said operation comprises transcoding 
("if desired the frame rate can be reduced by eliminating frames in order to 
further reduce the bandwidth required", [0026] Lines 7-9). 

Regarding Claim 19, White et al. discloses everything claimed as applied above 
(see Claim 17). In addition, White et al. discloses said operation is selected from the 
group consisting of bitrate reduction, rate shaping, spatial downsampling, spatial 
resolution reduction, frame rate reduction, key frame selection, a change in 
compression format, data packet elimination, and data packet truncation ("if desired 
the frame rate can be reduced by eliminating frames in order to further reduce the 
bandwidth required", [0026] Lines 7-9). 

4. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 
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(e) the invention was described iri (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21 (2) 
of such treaty in the English language. 

5. Claims 9-12, 14, 22-24 are rejected under 35 U.S.C. 102(e) as being anticipated 
by Koto et al. (PG Pub US 2003/0058934 Al). 

Regarding Claim 9, Koto et al. discloses a method of streaming media 
("compressed video transmission", [0001] Lines 1-2), said method comprising: 

receiving a plurality of media streams (video signals 1-2, 1-10, 2-4, Fig. 2), said 
plurality of media streams having a mutual downstream destination ("output to the 
network 1-25", [0008] and [0009]) and respective initial bandwidths associated 
therewith ("Since the transmission capacity of the network is already determined, 
the limitation of the transmission capacity of the compressed output data of each 
encoder can also be found from the number of encoders connected to the 
network 1-25", [0020] Lines 10-14); 

performing a service on each of said media streams, said service reducing a 
respective initial bandwidth of each media stream ("A video signal 1-2 output from 
the camera 1-1 is compressed by an encoder 2-1. Compressed data 1-4 issued 
from the encoder 2-1 is output to the network 1-25. Similarly, a video signal 1-10 
issued from the camera 1-9 is compressed by an encoder 2-2 and output to the 
network 1-25 as compressed data 1-12. A video signal 2-4 issued from the camera 
2-3 is compressed by an encoder 2-5 and output to the network 1-25 as 
compressed data 2-6", [0008] and [0009]); 
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streaming said plurality of media streams at less than their respective initial 
bandwidths ("the decoder 1-27 receives any of three pieces of compressed data 
transmitted to the network 1-25 as compressed data 1-26 to expand the received 
data", [0011] Lines 1-3); 

selecting at least one media stream from said plurality of media streams ("Which 
one of these compressed data is to be selected is determined in accordance with 
the compressed data selection signal 1-35", [0022], Lines 3-5); and 

streaming said at least one media stream at its initial bandwidth ("The decoder 
1-27 performs expanding operation to return the received compressed data to the 
original video signal", [0023] Lines 1-3). 

Regarding Claim 10, Koto et al. discloses everything claimed as applied above 
(see Claim 9). In addition, Koto et al. discloses said service comprises a transcoding 
operation ("In the above video image compressing operation, the video signal is 
subjected to digital processing to remove redundant information in the video 
image therefrom, thus reducing the size of the data", [0015] Lines 1-4). 

Regarding Claim 11, Koto et al. discloses everything claimed as applied above 
(see Claim 10). In addition, Koto et al. discloses said transcoding operation is selected 
from the group consisting of bitrate reduction, rate shaping, spatial downsampling, 
spatial resolution reduction, frame rate reduction, key frame selection, a change in 
compression format, data packet elimination, and data packet truncation ("In the above 
video image compressing operation, the video signal is subjected to digital 
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processing to remove redundant information in the video image therefrom, thus 
reducing the size of the data", [0015] Lines 1-4). 

Regarding Claim 12, Koto et al. discloses everything claimed as applied above 
(see Claim 9). In addition, Koto et al. discloses receiving information identifying a type 
of service to be performed ("the console issues a camera selection signal 1-33 to a 
compressed data selector 1-34. The compressed data selector 1-34 judges one of 
the video data pieces of the cameras selected by the operator console 1-32 on the 
basis of the contents of the camera selection signal 1-33, and outputs to the 
decoder 1-27 a compressed data selection signal 1-35 to select one of the 
compressed data pieces corresponding to the camera in question", [0012] Lines 
9-16). 

Regarding Claim 14, Koto et al. discloses everything claimed as applied above 
(see Claim 9). In addition, Koto et al. discloses said media streams are received at 
respective devices, each device servicing a respective media stream ("A video signal 
1-2 output from the camera 1-1 is compressed by an encoder 2-1. Compressed 
data 1-4 issued from the encoder 2-1 is output to the network 1-25. Similarly, a 
video signal 1-10 issued from the camera 1-9 is compressed by an encoder 2-2 
and output to the network 1-25 as compressed data 1-12. A video signal 2-4 
issued from the camera 2-3 is compressed by an encoder 2-5 and output to the 
network 1-25 as compressed data 2-6", [0008] and [0009]). 

Regarding Claim 22, Koto et al. discloses a computer-usable medium having 
computer-readable program code embodied therein for causing a network mixing device 
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to perform a method of streaming media ("compressed video transmission", [0001] 
Lines 1-2), said method comprising: 

receiving a plurality of media streams (video signals 1-2, 1-10, 2-4, Fig. 2), said 
plurality of media streams having a mutual downstream destination ("output to the 
network 1-25", [0008] and [0009]) and respective initial bandwidths associated 
therewith ("Since the transmission capacity of the network is already determined, 
the limitation of the transmission capacity of the compressed output data of each 
encoder can also be found from the number of encoders connected to the 
network 1-25", [0020] Lines 10-14); 

executing an operation on each of said media streams, said operation reducing a 
respective initial bandwidth of each media stream ("A video signal 1-2 output from 
the camera 1-1 is compressed by an encoder 2-1. Compressed data 1-4 issued 
from the encoder 2-1 is output to the network 1-25. Similarly, a video signal 1-10 
issued from the camera 1-9 is compressed by an encoder 2-2 and output to the 
network 1-25 as compressed data 1-12. A video signal 2-4 issued from the camera 
2-3 is compressed by an encoder 2-5 and output to the network 1-25 as 
compressed data 2-6", [0008] and [0009]); 

streaming said plurality of media streams at less than their respective initial 
bandwidths ("the decoder 1-27 receives any of three pieces of compressed data 
transmitted to the network 1-25 as compressed data 1-26 to expand the received 
data", [0011] Lines 1-3); 
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receiving information selecting at least one media stream from said plurality of 
media streams ("Which one of these compressed data is to be selected is 
determined in accordance with the compressed data selection signal 1-35", 
[0022], Lines 3-5); and 

streaming said at least one media stream at its initial bandwidth ("The decoder 
1-27 performs expanding operation to return the received compressed data to the 
original video signal", [0023] Lines 1-3). 

Regarding Claim 23, Koto et al. discloses everything claimed as applied above 
(see Claim 22). In addition, Koto et al. discloses said operation comprises transcoding 
("In the above video image compressing operation, the video signal is subjected 
to digital processing to remove redundant information in the video image 
therefrom, thus reducing the size of the data", [0015] Lines 1-4). 

Regarding Claim 24, Koto et al. discloses everything claimed as applied above 
(see Claim 22). In addition, Koto et al. discloses said operation is selected from the 
group consisting of bitrate reduction, rate shaping, spatial downsampling, spatial 
resolution reduction, frame rate reduction, key frame selection, a change in 
compression format, data packet elimination, and data packet truncation ("In the above 
video image compressing operation, the video signal is subjected to digital 
processing to remove redundant information in the video image therefrom, thus 
reducing the size of the data", [0015] Lines 1-4). 
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Claim Rejections - 35 USC § 103 

6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

7. Claims 7-8 and 20-21 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over White et al. 

Regarding Claim 7, White et al. discloses everything claimed as applied above 
(see Claim 1). However, White et al. fails to specifically disclose that said information is 
generated according to an edit list comprising instructions for editing said media 
streams, as claimed. 

Nevertheless, in another embodiment, White et al. teaches "the interactivity 
markup stream consists of a series of encoded commands which give type and 
position information" (White etal. [0049] Lines 4-6). 

Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time the invention was made to add an edit list to White et al.'s invention for 
editing the media streams because "the interactivity markup stream S3 describes 
regions of the presentation which provide for additional user interaction" (White 
etal. [0049] Lines 1-3). 

Regarding Claim 8, White et al. discloses everything claimed as applied above 
(see Claim 1). However, White et al. fails to specifically disclose that recording said 
media streams prior to said performing of said service, as claimed. 
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Nevertheless, in another embodiment, White et al. teaches "when a clip is 
selected as indicated at 801, the clip is stored and it is given a name as indicated 
on display 703" (White et al. [0042] Lines 1-3). 

Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time the invention was made to further allow White et al.'s multiple streams to be 
recorded before a service is performed because "the stored clips are available to the 
operator of the edit station 704" (White et al. [0042] Lines 3-4). 

Regarding Claim 20, White et al. discloses everything claimed as applied above 
(see Claim 17). However, White et al. fails to specifically disclose that said at least one 
media stream is selected in response to an edit list comprising instructions for editing 
said media streams, as claimed. 

Nevertheless, in another embodiment, White et al. teaches "the interactivity 
markup stream consists of a series of encoded commands which give type and 
position information" (White et al. [0049] Lines 4-6). 

Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time the invention was made to add an edit list to White et al.'s invention for 
editing the media streams because "the interactivity markup stream S3 describes 
regions of the presentation which provide for additional user interaction" (White 
etal. [0049] Lines 1-3). 

Regarding Claim 21 , White et al. discloses everything claimed as applied above 
(see Claim 17). However, White et al. fails to specifically disclose that said computer- 
readable program code embodied therein causes said network mixing device to perform 
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said method further comprising: recording said media streams prior to said executing of 
said operation, as claimed. 

Nevertheless, in another embodiment, White et al. teaches "when a clip is 
selected as indicated at 801, the clip is stored and it is given a name as indicated 
on display 703" (White et al. [0042] Lines 1-3). 

Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time the invention was made to further allow White et al.'s multiple streams to be 
recorded before a service is performed because "the stored clips are available to the 
operator of the edit station 704" (White et al. [0042] Lines 3-4). 
8. Claims 13, 15-16 and 25-26 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Koto et al. further in view of White et al. 

Regarding Claim 13, Koto et al. discloses everything claimed as applied above 
(see Claim 9). However, Koto et al. fails to specifically disclose a single device receives 
said media streams and performs said service, as claimed. 

Nevertheless, White et al. teaches "camera system 300 (which includes 
camera 102A to 102B) provides images to unit 301" (Koto et al. [0025] Lines 3-4, 
Fig. 3). 

Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time the invention was made to include a single device to perform services to the 
received media streams because "the unit 301 which edits the image streams" 
(Koto et al. [0025] Lines 4-5). 
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Regarding Claim 15, Koto et al. discloses everything claimed as applied above 
(see Claim 9). However, Koto et al. fails to specifically disclose said selecting is made 
according to an edit list comprising instructions for editing said media streams, as 
claimed. 

Nevertheless, White et al. teaches "the interactivity markup stream consists 
of a series of encoded commands which give type and position information" 
(White et al. [0049] Lines 4-6). 

Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time the invention was made to add an edit list to Koto et al.'s invention for editing 
the media streams because "the interactivity markup stream S3 describes regions 
of the presentation which provide for additional user interaction" (White etal. 
[0049] Lines 1-3). 

Regarding Claim 16, Koto et al. discloses everything claimed as applied above 
(see Claim 9). However, Koto et al. fails to specifically disclose that recording said 
media streams prior to said performing of said service, as claimed. 

Nevertheless, White et al. teaches "when a clip is selected as indicated at 
801, the clip is stored and it is given a name as indicated on display 703" (White 
etal. [0042] Lines 1-3). 

Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time the invention was made to further allow Koto et al.'s multiple streams to be 
recorded before a service is performed because "the stored clips are available to the 
operator of the edit station 704" (White et al. [0042] Lines 3-4). 
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Regarding Claim 25, Koto et al. discloses everything claimed as applied above 
(see Claim 22). However, Koto et al. fails to specifically disclose that said information 
for selecting comprises instructions for editing said media streams, as claimed. 

Nevertheless, White et al. teaches "the interactivity markup stream consists 
of a series of encoded commands which give type and position information" 
(White et al. [0049] Lines 4-6). 

Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time the invention was made to add an edit list to Koto et al.'s invention for editing 
the media streams because "the interactivity markup stream S3 describes regions 
of the presentation which provide for additional user interaction" (White et al. 
[0049] Lines 1-3). 

Regarding Claim 26, Koto et al. discloses everything claimed as applied above 
(see Claim 22). However, Koto et al. fails to specifically disclose that said computer- 
readable program code embodied therein causes said network mixing device to perform 
said method further comprising: recording said media streams prior to said executing of 
said operation, as claimed. 

Nevertheless, White et al. teaches "when a clip is selected as indicated at 
801, the clip is stored and it is given a name as indicated on display 703" (White 
etal. [0042] Lines 1-3). 

Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time the invention was made to further allow Koto et al.'s multiple streams to be 
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recorded before a service is performed because "the stored clips are available to the 
operator of the edit station 704" (White et al. [0042] Lines 3-4). 

9. Claim 6 are rejected under 35 U.S.C. 103(a) as being unpatentable over White 
et al. in view of Koto et al. 

Regarding Claim 6, White et al. discloses everything claimed as applied above 
(see Claim 1). However, White et al. fails to specifically disclose said media streams 
are received at respective devices, each device servicing a respective media stream, as 
claimed. 

Nevertheless, Koto et al. teaches "a video signal 1-2 output from the camera 
1-1 is compressed by an encoder 2-1. Similarly, a video signal 1-10 issued from 
the camera 1-9 is compressed by an encoder 2-2 and output to the network 1-25 
as compressed data 1-12. A video signal 2-4 issued from the camera 2-3 is 
compressed by an encoder 2-5 and output to the network 1-25 as compressed 
data 2-6" (Koto et al. [0008] and [0009] and Fig. 2). 

Therefore, it would have been obvious to a person having ordinary skill in the art 
at the time the invention was made to include respective devices for the media streams 
to perform services because "the network 1-25 may be network lines which can 
multiplex a plurality of pieces of data" (Koto et al. [0007]). 

Citation of Pertinent Prior Art 

1 0. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 
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Phillips et al. (PG Pub US 2005/0052578 A1) discloses systems and methods 
for providing picture-in-picture, or other multi-picture displays. 

Bantz et al. (PG Pub US 2004/0128694 A1) discloses a system and method for 
permitting an end user to select a media stream and immediately experience the audio 
and video of that stream, in order to evaluate whether the stream is appropriate to the 
user's interests and needs. 

Pearlstein (US Patent No. 5,691,986) discloses methods and apparatus for 
inserting data into an encoded data stream. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Christine Duong whose telephone number is (571) 270- 
1664. The examiner can normally be reached on Monday - Friday: 830 AM-6 PM EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Seema Rao can be reached on (571) 272-3174. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 



Application/Control Number: 10/698,606 



Page 19 



Art Unit: 2616 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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